Roundoff-induced Coalescence of Chaotic trajectories 
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Numerical experiments recently discussed in the literature show that identical nonlinear chaotic 
systems linked by a common noise term (or signal) may synchronize after a finite time. We study 
the process of synchronization as function of precision of calculations. Two generic behaviors of 
the average coalescence time are identified: exponential or linear. In both cases no synchronization 
occurs if iterations are done with infinite precision. 
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It is well known that deterministic systems may ex- 
hibit a chaotic behavior Typically, two chaotic or- 
bits initially displaced only slightly from each other de- 
^ viate exponentially with time approaching separation on 
^^"i [ the order of the strange attractor size. In practice it 
^\ • means that small errors make longtime evolution of non- 
04 ' linear, dynamical systems unpredictable [Q. Thus, iden- 
tical chaotic systems are not expected to synchronize. 
' Recently, in a series of papers it has been 

J — > demonstrated that synchronization could nevertheless be 
y—i ' achieved if the systems are linked by a common signal or 
noise term of an appropriate strength. That is, if we take 
a chaotic map and start numerical evolution of two arbi- 
trarily chosen initial points subject to the same sequence 
of noise, the resulting trajectories will collapse after a 
finite number of iterations. 

Two cases could be distinguished. The first one, dis- 
' cussed by Pecora et al. and Fahy et al. |^ (PF), de- 
I fines the collapse as a process where the average distance 
between the trajectories converges exponentially to zero. 
pH ' According to PF such synchronization takes place if the 
O ' largest Lyapunov exponent becomes negative. 
^ [ A different scenario was found by Maritan and Banavar 
•'H . (MB) Q. They claimed that the coalescence also may oc- 
r^J I cur abruptly, without any specific time dependence of the 
■ average distance between the trajectories. As an exam- 
ple they studied the well-known one- dimensional logistic 
map in the presence of additive noise 

x' = 'ix{l-x) + Wrj (1) 

where 0<a;< l;7yisa random number chosen uniformly 
from the interval —1 to -1-1 and > is the strength 
of the noise. The values of rj violating the bounds < 
x' < 1 were discarded and a new rj was chosen. They 
found that for W > Wc {Wc ~ 0.55) and after about 
10^ iterations the trajectories of almost any two points 
became identical and follow a single random trajectory. 
As conclusion they claimed that in the limit of infinite 
time and finite precision all trajectories should collapse 
for W > Wc- Thus a,t W = Wc one would get a kind of 
phase transition. Several data were exhibited to confirm 
the collapse and the existence of the transition. 
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Recently Pikovski ||^ has suggested that the synchro- 
nization observed by MB is a numerical effect of finite 
precision of calculations. However no systematic analy- 
sis has been given. It is therefore of interest to investigate 
the effect of computer roundoff on the coalescence, which 
we would like to propose in this letter. We show that the 
average coalescence time (or simply the relaxation time) , 
T, for the two orbits of the model (1) follows the ex- 
ponential law: T = qA(w)+b(W)n ^-^^^ ^ q ^^^^^ 

functions of the noise strength; iV is the precision of the 
calculations. This law, which is different from the one 
suggested in ||] , proves that statistically the coalescence 
never occurs for a map or flow of infinite precision. 

We also show that no nontrivial critical value Wc ex- 
ists. Even for W < 0.5 the collapse does occur. If we 
consider finite precision iterations and W > Wmin = 
0.5x10"^ then the two different trajectories should al- 
ways collapse. As conclusion one can say that the limit 
discussed in the paper of MB (first, time going to infinity, 
then the precision going to infinity) is trivially satisfied 
in the sense that (almost) all two points coalesce in this 
limit. Finally, a synchronization by common signals ob- 
served in the chaotic systems with negative Lyapunov 
exponents yields the relaxation time linear with N. 

Our analysis starts by considering the map studied by 
MB, Eq.(p. But the approach differs from that of MB 
in the way the map is iterated. Namely, we perform the 
iterations with controlled absolute accuracy by fixing the 
number of digits after decimal point. More specifically, 
for all numbers from interval [0, 1] with decimal repre- 
sentation X — 0.aia2 • ■ ■ CLN the value of N is being fixed 
after each iteration. Here the symbol "." represents dec- 
imal point and = 0,1,..., 9 (i — 1,...,N). For x = 1 
we get automatically x' = 0. 

Finite accuracy calculations are done with programs 
running under control of the MAPLE package. To use the 
program the precision N has to be fixed. We assume N 
to vary from 1 to 16. Next, the noise strength W must 
be given and the two initial numbers for the trajecto- 
ries chosen randomly from the interval [0, 1]. After these 
preparations are done we start two independent itera- 
tions according to the prescription (|l|) . The process con- 
tinues until both trajectories became numerically iden- 
tical. The corresponding number of iterations is called 
coalescence time and denoted t. The whole procedure 
(with fixed N and W) is repeated 100 times to get T. 

Results of the simulations are shown as triangles in 
Fig.(l), where ln(T) varies with N for W = 0.7. Circles 
represent similar simulations but with N denoting rela- 
tive precision i.e. the number of digits in the mantissa as 
in usual floating point arithmetic. Note that for the map 
given by Eq.(l), the absolute- and the relative precision 
calculations yield statistically the same results. 

Additionally, two histograms representing the proba- 
bility distribution function P{t) that the coalescence time 
is t, are shown as insets of Fig.(l). They are constructed 
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for N = 8 and for two different samples composed of 100 
and 10000 points, respectively. Though t has substantial 
statistical fluctuations, the difference between ln(T) cal- 
culated for both samples differs by less than 0.9%. Sim- 
ilar result is found for iV = 15 with the averages taken 
over 100 and 1000 points. Hence 100 realizations of the 
process provide a useful estimate of ln(r). 

We shall observe that T increases exponentially with 
N. This has been shown in Fig.(l) by plotting a line 
ln(T) ~ 2.297 -I- 0.765 (16 > TV > 3) of the best least 
- square fit, which on the average is good to within bet- 
ter than 2.5%. Interestingly, similar linear dependence of 
ln(T) on N is predicted for other values of W. This in- 
dicates that (statistically) two trajectories never collapse 
in the limit of infinite precision. 

At this point we would like to turn to the results of MB. 
They found coalescence of the trajectories for W — 0.6 
but not for W = 0.3, in both cases the number of itera- 
tions being 5x10^. Clearly, for W = 0.3 the number of 
iterations they performed was much too small to see coa- 
lescence. We found that for double precision experiments 
and for W = 0.5 - 0.6, time T is orders of magnitude 
smaller than that for W = 0.1 or = 0.3. More specif- 
ically, for = 0.1 the collapse is expected after about 
10^^ iterations while for W — 0.3 after 10^^ iterations. 
This effect is illustrated in Fig. (2), where ln(T) is plotted 
as a function of W for different values of A^. As previ- 
ously averages are taken over 100 i's. Again the influence 
of scatter of the data on ln(T) is tested for = 3 and 
N — 7 where additionally the averages are taken over 
1000 experiments. In both cases the results are practi- 
cally independent of the sample size. For = 3 this is 
shown in Fig. (2) where triangles represent averages over 
100 experiments and circles over 1000. It is seen that T is 
high for small values of W and decreases with increasing 
W. A minimum of T is found around W = 0.6. Then 
T increases again to finally saturate for W > 1. This 
behavior is observed for all values of N studied and its 
origin will be explained later in the paper. 

Now one can easily understand the results of MB, pre- 
sented in their Fig. (2). A maximum of the probability 
that the two trajectories collapse (denoted as A in [^), 
corresponds to our minimum of T (see Fig. (2)). Likewise, 
the decrease of A for W > 0.6 is connected with our in- 
crease of T. The difference between our results and theirs 
is that we do not observe any transition around W = 0.5. 
Generally we find that collapse takes place for all values 
of W such that W > Wmin- This has been checked for 
N < 8. For higher values of A^ time t becomes too long 
and calculations are practically impossible. 

In order to understand why W must be nonzero to 
get collapse please note that any chaotic map looses 
its chaotic character when iterated with a finite ac- 
curacy Take, for example, the logistic map (|l|) 
and fix accuracy to N = 3. The domain of the 
map consists in this case 10'^ -|- 1 states (boxes) equal 
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(0,0.001,0.002, •••,0.999,1). For = these num- 
bers evolve either to one of the fixed points: a; = or 
X = 0.750 or to a cycle of length 13: {0.109, 0.190, 0.204, 
0.328, 0.388, 0.416, 0.616, 0.650, 0.882, 0.910, 0.946, 
0.950, 0.972}. Thus, in the absence of noise the trajec- 
tories belong to periodic orbits or fixed points and only 
accidentally they can collapse. For W ^ the struc- 
ture of the cycles is destroyed. Even the smallest nu- 
merical value of the noise {W — W,nin), which either 
does not modify the iterated states or modifies them by 
±0.001 (each realization being of the same probability 
equal 1/3), is sufhcient to have nonzero probability that 
all initial states are again accessible from any other state 
after a finite number of iterations. Interestingly, Wmin 
does not depend on detailed structure of periodic orbits 
indicating that any sort of noise that restores ergodic- 
ity would yield collapse of the trajectories. The same 
statements hold for arbitrary N. Instead, if we consider 
infinite accuracy the probability that two numbers com- 
ing out of iterations are different is one. As we are in 
chaotic region, where dynamics is strongly sensitive to 
the initial conditions, these two points will move away 
from each other in the forward iterations. 

Another new feature of the logistic map found in our 
simulations and displayed in Fig. (2) is behavior of the 
curves In (T) as function of N. Namely they all scale 
linearly with N, i.e. ln{T) = A{W) + B{W) N, with W- 
dependent coefficients. Using the data shown in Fig. (2) 
we estimated v4(iy) and B{W) by performing linear least 
square fit for each W separately. The obtained set of 
points is given in Fig. (3). These data show that for W ~ 
1 the time T behaves as 10^/^ ^^d for W = 0.6 as 10^/^ 
which differs from the 10^^-law suggested in 

Finally, the Fig. (3) allows one to estimate T for W = 
0.3 and for TV = 15 as being of order of 10^^. This is the 
reason why in experiments of MB, which dealt with 10^ 
iterations, the collapse for W = 0.3 statistically has not 
been observed. 

A further insight into the coalescence process and its 
connection to the accuracy could be achieved by convert- 
ing the logistic map (1) into the 2y modulo 1 map 

y' = 2y modulo 1 -|- g{W, r], ...). (2) 

This is done in practise by a change of variables: a; = 5 [ 
1 — cos(27r?/)] . Note that the transformed noise, de- 
noted by g{W,r], ...), depends at time n on the system 
states prior to n. This dependence, represented by dots 
in Eq. (^) , appears quite nontrivial and will not be of our 
concern here. Instead we will discuss a simple case where 
precise form of g{W, rj, ...) is irrelevant. Again the values 
of g violating the bonds < y' < 1 are discarded. 

Suppose that we study the binary version of the map 
(^ in the interval [0,1). That is we iterate the map by 
representing each number (including the noise term) as a 
binary decimal 0.010203 • • • o^v • • • = Xii^i 2~*ai, where 
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each of the digits ai is either or 1. With this simple 
change of base the iterations of the map (||) could be 
viewed as moving the decimal point "." one position to 
the right (Bernoulli shift). 

A binary number of accuracy N could now be intro- 
duced as the one for which aj — 0, > N. Consider 
two arbitrary numbers x and y of binary accuracy N 
and assume that their binary representations are of the 
form O.X1X2X3 • ■ • xn and 0. 2/12/22/3 • • • Vn, respectively. 
The first iteration moves the points one step to the right 
yielding x' = O.X2X3 ■ • ■ xpfO and y' = 0. 2/22/3 • ■ • VnO- As 
the last digit (zero) is now the same for both numbers 
x' and y' the noise converts them into two numbers with 
the same digit (the N-th digit of the noise) at position 
N after the point. Successive iterations in the presence 
of noise increase the number of identical digits by one 
making the coalescence time t ^ N and, consequently, 
T must be a linear function of N. Similar linear be- 
haviour of T with N is predicted for the PF models . 
This follows directly from the fact that the average dis- 
tance, d, between the PF trajectories at the time T is 
d = Aq10~'^/-^, where Aq and A are model dependent 
parameters. Comparing d with 10"''^ yields T ^ XN. 

Let us now come back to the logistic map and comment 
two issues: (a) why the minimal T is found for ^ 0.5 
and (b ) how T could be connected with the properties of 
the map and of the noise. An important point to note 
(see also Q]) is that, in general, chaotic maps consist of 
iterations that are composed of two parts, the one which 
stretches the distance between the points and the other 
where the distance is enlarged. Consider the distance di 
between images of x and y 

di:S^{x,y)-^A\x-y\\l-{x + y)l (3) 

where S — [0, 1] x [0, 1]. Then the distance contracting 
region, fi, is given by the condition: 3/4 < x + y < 5/4, 
where (x,y) £ S. That is, V (x,y) £ 51: di{x,y) < 
\x — y\. If we require that the reduction of the dis- 
tance is smaller than e i.e. di{x,y) < s\x — y\ then 
the states (x, y) must be restricted to a strip fi^ C 51 
given by the inequality 1 — £/4<a;-|-j/<l-|-e/4. The 
area il^ C ile, where shrinking of the distance is being 
the strongest, is found around {x,y) = (1/2, 1/2), where 
dz(l/2±£/2,l/2±e'/2) = - (e'n 

To proceed further we assume that the random orbits 
are described by the joint probability distribution func- 
tion pwix, y) {{x, y) G S) and apply the noise to all pairs 
of numbers {x,y). Now the probability Pwi^) that this 
procedure yields two numbers such that after applying 
the map, they are moved into the contracting area is 
given by the formula 

Pw(£)= / dxdypw[x,y)— 4 

where I{x, y; W) is the interval from {x — W,y ~ W) to 
{x + W,y + W) of length \I{x, y;W)\ = 2V2W. The key 
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quantity entering the formula (Q) is pw{x,y). Clearly, 
pw{x,y) should be peaked about the diagonal x = y 
with strong (absolute) maximum at {x,y) = (1, 1). This 
observation follows from the fact that the logistic map 
exhibits singular density of states near 1 and and that 
the points around are images of those around 1. As af- 
ter each iteration the noise is added (with the constraint 
that the pair of numbers stays within the basin of at- 
traction of the map) the points around are obtained 
less frequently. Thus, to get maximal probability P{e) 
the integration in (^ should include the region around 
(1, 1) which implies that W > 0.5. On the other hand the 
second term under integral, which gives the probability 
of finding the noise-shifted point in fig, is for W ^ 0.5 a 
decreasing function of W and saturates for W > 1. Com- 
bining these two facts we conclude that Pwi^) should be, 
for 14^ < 1, a decreasing function of W, approaching sat- 
uration ioT W > 1. The saturation could be proceeded 
by a maximum, laying between 0.5 ^ W 1. In this 
case one gets minimum of T for 0.5 < < 1. Finally, 
lime_,o Pwi^) implies that T — > oo for ^ cx). 

The upper limit of T for W ^ 0.5 also could be found 
from the formula (jj). As the distribution pwix^y) is 
strongly peaked around (1,1) the function Pwi^) actu- 
ally gives a probability of finding a point in the area n^- 
From (^) it follows that the frequency of getting a point 
in rig is proportional to e which gives T ^ 1/e. For 
£ — 10~^/^ the image of any point from yields two 
numbers that are 10~^ apart indicating that the two tra- 
jectories just collapsed. Hence T ~ 10^/^, which is what 
we find for W 1. 

These observations have important practical conse- 
quences. They suggest that the coalescence time to a 
fixed precision could be controlled by the noise. For the 
map (0) this is achieved by accepting only these 77's in (|^) 
which give points {x' ,y') restricted to 51^. Allowed values 
of £ as functions of assumed N and T and for W > 0.5 
could again be inferred from Eq.(^. 

In conclusion, we showed that in order to understand 
the recently observed phenomenon of coalescence of the 
trajectories the precision of the calculations must 
be taken into account. For all systems studied in the lit- 
erature so far, the average coalescence time T is either 
linear or exponential function of precision of the calcula- 
tions. Thus, statistically, coalescence never occurs when 
precision is infinite. Clearly the arguments as given are 
of general validity and the logistic map or the tent map 
could serve as examples. 

One may wonder as whether predicted linear (or ex- 
ponential) behaviour of T with N could be correlated 
with the sign of the maximal Lyapunov exponent. If the 
identical chaotic systems are subject to an external noise, 
which is generated at each time step independently of the 
previous values and of the states of the systems, than the 
analysis proposed by Pikovsky applies In this case 
the largest Lyapunov exponent can be calculated from a 
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single system. If this exponent is negative than, at least, 
for the systems studied in |^] this would imply the linear 
dependence of T with N {i.e. synchronization). How- 
ever, such linear dependence does not necessary mean 
that the maximal Lyapunov exponent must be negative. 
For example, in the case of the binary tent map, where T 
varies linearly with N (Vi?), the sign of the Lyapunov ex- 
ponent (for N ^ oo) could be arbitrary. Also we would 
like to add that the technique |Q does not apply when 
the noise depends on the states of the systems, Eqs.(^|]). 
In this case the difference between ensembles with posi- 
tive and negative Lyapunov exponents is highly nontrival 
. This issue is currently under investigations and will 
be reported elsewhere. 

Finally, let us note that T is governed by the properties 
of the invariant density of the chaotic map, the structure 
of the distance stretching area(s), and the way in which 
the noise is introduced. This is demonstrated for the 
random logistic map (1), where T varies exponentially 
with N . The law we found is different from a simple 
(10~^)^^ dependence suggested in ^ (= e^^ , where 
_D = 2 is the topological dimension of the space). 
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FIG. 1. Logarithm of average relaxation time versus ac- 
curacy for W = 0.7. The straight line represents best 
least-square fit obeying 3 < A'^ < 16. Triangles represent 
absolute accuracy calculations while circles relative ones. For 
each accuracy average is performed over 100 samples. Insets 
show the histograms of the coalescence times for N = 8 and 
for two sample sizes equal 100 and 10000, respectively. 



FIG. 2. Logarithm of the average relaxation time versus 
the strength W of the noise. Accuracies considered are N = 3 
(triangles and circles), 4 (losangles), 5 (pentagons) and 6 
(hexagons). Averages are performed over 100 samples except 
for AT = 3 (circles) which corresponds to 1000 samples. The 
lines are introduced to guide eyes. 



FIG. 3. Coefficients A{W) (thin line) and B{W) (thick 
line) of T(N) for the model (1). The lines are guide-to-eyes. 
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